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We discuss the issue of temperature chaos in the Sherrington-Kirkpatrick spin glass mean field 
model. We numerically compute probability distributions of the overlap among (equilibrium) con- 
figurations at two different values of the temperature, both in the spin glass phase. The situation 
on our medium size systems is clearly non-chaotic, but a weak form of chaos could be emerging on 
very large lattices. 
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Two years after our paper [1] on the subject (that we 
will quote as (A) in the following) we are coming back 
to the problem of temperature chaos in spin glasses and, 
more widely, in disordered and complex systems. A prob- 
lem that is, we believe, still a very open one. 

In these two years the problem of temperature chaos 
has been studied under many new lights. One can fairly 
say that indications are mixed, with some preference for 
a no-chaos scenario on medium size systems: the detailed 
discussion of [2] (where arguments against the possibility 
of a strong chaos picture are given) is probably a perfect 
starting point for the reader interested in the details of 
the subject. 

Perturbation theory in an expansion below T c (in mean 
field theory [3] ) when pushed to the fifth order shows ab- 
sence of chaos through highly non-trivial cancelations, 
although one finds no general feature that could imply 
that these cancelations will be present at all orders in 
perturbation theory. The naive TAP equations for the 
mean field Sherrington-Kirkpatrick model, when solved 
numerically on systems with order of 10 2 spins, also lead 
to exclude the presence of temperature chaos [4] . 

Bouchaud and Sales have shown that there is no chaos 
in the REM model (but if one sits exactly at T c ) [5]. 
On the contrary Sales and Yoshino have discussed in [6] 
the case of DPRM (directed polymers in random me- 
dia), and have shown that there is temperature chaos in 
this model, and that a temperature perturbation plays 
a role very similar for example to a perturbation in the 
potential: i.e. in the case of DPRM temperature pertur- 
bation looks generic and creates chaos. The recent work 
by Sasaki and Martin [7] describes situations where chaos 
is present. 

These recent studies add new elements to the many 
former studies of an interesting problem first discussed 
by Parisi [8] , and then studied in many other works (see 
among others [9-14]). Still the presence or the absence 



of temperature chaos is one of the few open problems 
remaining in the Sherrington-Kirkpatrick model. 

Let us start by reminding which were the main results 
of our first paper (A) . There we discussed the behavior 
of the two-temperature overlap 
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for systems with N spins. The over-line is for the av- 
erage over the quenched disorder, the brackets are for 
the thermal average, {crj 1 } is an equilibrium configura- 
tion of Ising spins at temperature Ti, while {o~J 2 } is at 
temperature T 2 . We have considered the Sherrington- 
Kirkpatrick spin glass mean field model, a diluted finite 
connectivity mean field spin glass model, and the 3D 
Edwards-Anderson spin glass. In a T-chaotic situation 
we would expect Q^i't^ to go to zero in the infinite vol- 
ume limit, as soon as T± 7^ T%. We found however that 
for all models we studied (on systems with up to 4096 

sites) Q^iTa was n °t smau f° r T2 — T\ finite and reason- 
ably large. To be more precise we found that in our data 
we had always 
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gg>;W > 0, for T C >T 2 > T[ mm) > 0.4T C 



(2) 

even if the value of the l.h.s. was decreasing with increas- 
ing volumes. The validity of the relation (2) is sugges- 
tive of a very non-chaotic situation (it would hold for an 
usual ferromagnet), even if from the numerical data of 
(A) it was clear that asymptotically it may well be vio- 
lated (that is in any case not enough to imply a T-chaotic 
behavior). 

So (A) was suggesting a clear absence of chaotic be- 
havior on medium size systems, while showing that for 
increasing lattice sizes signs of a (modestly) more chaotic 
behavior were possibly starting to appear. We note here 
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again that systems with a not huge number of spins can 
be relevant to the physics of spin glasses. The exper- 
iments of reference [15] show that the number of spin 
involved in the collective behavior observed in a typical 
spin glass experiment is of the order of 10 5 , that is not 
so far away from the number of spins we can handle nu- 
merically today. Accordingly, even if it should emerge 
that T-chaos is asymptotically present for very large vol- 
umes, the present numerical simulations could turn out 
to describe reasonably well the experimental regime. 

In order to get further informations on the sensitiv- 
ity of the spin glass phase with respect to temperature, 
we have decided to measure the full probability distri- 
bution of the overlap of configurations equilibrated at 
different values of the temperature: -Pti,t 2 (<7) (In (A) we 
restricted ourselves to the second moment of this distri- 
bution). In terms of Pt 1 ,t 2 (q)^ temperature chaos just 
means that limjv^oo Pti,t 2 (9) = 8(q), for any T\ ^ T2 . 
A more complete information like the one contained in 
the full probability distribution of the order parameter 
can indeed allow a more detailed analysis of the scaling 
behavior, making possible to uncover a wider range of 
phenomena. 

Since the three models studied in (A) were showing 
a very similar behavior, we focus here on one of them, 
namely the Sherrington-Kirkpatrick model. 

The numerics are very similar to the ones of (A) , and 
we refer to [1] for a discussion of the details of the sim- 
ulations. We use binary quenched random couplings, 
J = ±1. Here we have studied systems with N = 64, 
N = 256, N = 1024 and N = 4096 spins, down to 
T = 0.4 = 0.4 T c . We have used a multi spin (differ- 
ent spins are encoded in the same computer word) ver- 
sion [16] of the parallel tempering Monte Carlo algorithm. 
Two copies of the system at each one of a set of tempera- 
ture values (0.4, 0.4+ AT, 0.4+2AT • • ■, with AT = 0.025 
but for N = 4096 where AT = 0.0125) are brought to 
equilibrium (in the same realization J of the couplings) 
and are used to compute the P^\. (q) (more precisely the 
subset with temperatures 0.40, 0.45, 0.50, • • •) . An aver- 
age over 1024 different realizations of the quenched disor- 
der (256 for N — 4096) is taken to compute the average 
Px^Tjiq)- This is an order of magnitude more disorder 
samples than in [1]. For each realization we have per- 
formed 400K sweeps for equilibrium plus 1000-ftT sweeps 
for measurements (520-ftT only for N = 4096). 
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FIG. 1. P(q) in a non-diagonal case (Ti = 0.4 and 
T-2 — 0.6) and for the two corresponding diagonal cases 
(Ti =T 2 = 0.4 and Ti = T 2 = 0.6). Here N = 64. 
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FIG. 2. As in figure 1 but for N = 256. 
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FIG. 3. As in figure 1 but for N = 1024. 
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FIG. 4. As in figure 1 but for TV = 4096. 

We show at first the probability distributions them- 
selves (normalized by J", P(q)dq — 1). This distribu- 
tions have been symmetrized, although they are quite 
symmetric, even sample by sample. In each of figures 1, 
2, 3 and 4 we show three Pti,t 2 (<z) : the non-diagonal one 
that gives the probability of the overlap of configurations 
at T = 0.4 (the lower temperature we equilibrate) with 
configurations at T ~ 0.6, and the two diagonal probabil- 
ity distributions with T\ = T% = 0.4 and T\ = T2 = 0.6 
respectively. In figure 1 we have data from our smallest 
lattice with N = 64, in figure 2 from N = 256, in figure 
3 from N = 1024, and in figure 4 we have data from the 
largest lattice, with N = 4096. 

On the smallest lattice (figure 1) the peak of the non- 
diagonal P(q) is higher than the one of i"b.6,o.6j and its 
position is basically at half way between the positions of 
the maxima of Po.4,0.4 an d -Po.6,0.6- This is typically what 
would happen in a ferromagnet. For increasing volumes 
the position of this peak is moving (very slowly) to lower 
values of q, but does not seem to approach q = (we will 
discuss in detail this point in the following). 
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FIG. 5. P{q) for the non-diagonal case only (Ti = 0.4 and 
T2 = 0.6) for different lattice volumes. For giving more infor- 
mation about the actual form of the measure curves we only 
plot errors in the q > part of the plot. 

In figure 5 we show in the same plot the four non- 
diagonal Po.4,0.6 for N = 64, 256, 1024 and 4096. These 
Pq. 4, 0.6 (?) are normalized and are drawn on the same 
scale, so that a visual comparison of the four curves is 
meaningful. Here we see that the q 7^ peak of PoAfl.eil) 
do increase as function of N (but for a negative analy- 
sis of this statement see later in the text and figure 7), 
and that its position shifts only very little towards q = 0. 
The mass carried by the distribution P(q) in q ss seems 
to be increasing on the largest lattice, but this effect is 
affected by a large statistical error. Figure 4 shows in- 
deed wiggles in Pq 4. 0.4(g) that are known not to exist in 
the infinite volume limit, and are accordingly to be at- 
tributed to the limited number of disorder samples. The 
bump popping up around q = in figure 5 is compatible 
with the statistical error. It is not visible in our data for 
larger T x values (0.45, 0.50, • • •)■ 
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FIG. 6. The values of q where P(q) is maximum, gmax, for 
the diagonal and non-diagonal P(q) as function of TV -1 / 3 . 

In figure 6 we plot the values of q where P(q) is max- 
imum, gmax, for the diagonal and non-diagonal P(q) 
at different N values. The two points at N — 00 for 
-Po. 4, 0.4(9) and Pq. 6, o.e(<z) have been obtained [17] using 
the method of [18]: they show how reliable is a linear fit 
in of our data for the diagonal distributions. The 

points for Po. 4,0.6(9) show some curvature, but the effect 
is not dramatic, and a non-zero value in the limit N — > 00 
is surely favored. 
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FIG. 7. -P(gmax) as a function of for the three different 
P(q)- 

As we have already shown, the peaks of the (tempera- 
ture) non-diagonal P(q) increase when N increases, but 
not as fast as the ones of the diagonal P(q). In figure 7 
we show the value of P(<?max) for the different N values 
and for the three P{q) we are discussing. The height of 
the peaks of the two diagonal P(q) increases exactly like 
N$ as it should. The two continuous straight lines are 
the best linear fit to the diagonal data: the fits turn out 
to be very good. 

From figure 7 the situation of Po. 4, 0.6(9) looks quite 
different. Here the growth slows down at N = 1024 and 
is really small on our largest lattice size with N — 4096. 
We do not believe that one can draw precise quantitative 
conclusions from figure 7: a (weak) non-chaotic picture 
could survive in the infinite volume limit, or chaos could 
appear very slowly (only on very large volumes). Let us 
spell clearly, in any case, that the mechanism that will 
govern a possible appearance of chaos will be based on 
the Pt 1 ,t 2 ('?) having two q = and and at q — q* > 0, 
and by having the q — peak growing for increasing 
volume at the expense of the q* peak. In any case our 
numerical results appear to support the idea that tem- 
perature chaos will not be effective on the typical sizes 
that are relevant in spin glass experiments [15]. 
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FIG. 8. 1Z as defined in equation (3) as a function of N 3 . 

In order to be more quantitative we have also looked at 
the ratio of the mass carried by Po. 4, 0.6(9) close to q = 
as compared to the mass carried by the large q region. 
We define 



K 



C:n<Ddq 



(3) 



where k is a normalization constant, and we take m = 
0.05 (a very similar picture would be obtained for any m 
not too large). 1Z decreases with N if the mass of the 
peaks at large q dominates, while it increases when the 
dominating contribution is the one at q w 0. 

We plot TZ for Po. 4, 0.6(9) versus iV~s in figure 8. TZ 
is constant on the smaller lattices, but starts increas- 
ing on the largest lattice size. The error due to sample 
to sample fluctuations is here very large (the simulation 
at N — 4096 have been very costly in computer time), 
and the growth of TZ is not significant at more than two 
standard deviations, but an effect is very plausibly there. 
Again, this is probably an indication toward the fact that 
temperature chaos could eventually emerge on very large 
systems. 

It is worth noticing that if temperature chaos is 
(slowly) emerging when increasing N this is probably not 
happening with the position of the two peaks at large |g| 
shifting to q = 0, but with a third peak in q = emerg- 
ing and eventually becoming the only contribution, and 
accordingly a discontinuity in 9max as function of iV -1 / 3 
(Figure 6). 

The problem of temperature chaos, already at the 
mean field level, is turning out to be a hard problem: 
this is true both for analytical and for numerical compu- 
tations. Here we have provided some further hints about 
the behavior of the system in the infinite volume limit: 
the very large scale, state of the art simulations we have 
been able to run, give some suggestions, probably hinting 
in favor of a very weak chaos that would emerge only for 
very large lattice sizes. 
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